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The nature of electronic states due to strong correlation and geometric frustration on the triangu- 
lar lattice is investigated in connection to the unconventional insulating state of Na I Co02 at x = 0.5. 
We study an extended Hubbard model using a spatially unrestricted Gutzwiller approximation. We 
find a new class of charge and spin ordered states at x = 1/3 and x = 0.5 where antiferromag- 
netic (AF) frustration is alleviated via weak charge inhomogeneity. At x = 0.5, we show that the 
\/3a x 2a off-plane Na dopant order induces weak \/?>a x la charge order in the Co layer. The 
symmetry breaking enables successive y/3a x la AF and 2a x 2a charge/spin ordering transitions 
at low temperatures. The Fermi surface is truncated by the 2a x 2a hexagonal zone boundary into 
small electron and hole pockets. We study the phase structure and compare to recent experiments. 
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Sodium doped cobaltate Na^CoO^ has emerged re- 
cently as an important, layered triangular lattice fermion 
system with a rich phase structure These include a 
5K superconducting phase near x = 1/3 upon hydra- 
tion [2J ; an A-type antiferromagnetic ( AF) phase around 
x = 0.8 [3j; and an unexpected insulating state at x = 0.5 
A series of experiments find the insulating state un- 
conventional. While the magnetic susceptibility shows 
two cusps at T m i = 88K and T m 2 = 53K, the in-plane 
resistivity exhibits only a derivative feature at T^i, fol- 
lowed by a metal-insulator transition below T m 2 [lj . The 
insulating state has a small optical gap of 15meV 0, HI 
and an anisotropic single-particle gap of ~ 8meV in angle 
resolved photoemission spectroscopy (ARPES) [fj. Elec- 
tron diffraction 0, S] shows that Na orders into \/3a x 2a 
(hereafter we set a = 1) supercells below ~ 300K, sug- 
gesting that dopant order induced charge order may play 
a role in the insulating behaviors [H, 0, [|1] . However, NMR 
experiments show that the Co valence exhibits small dis- 
proportionation with no appreciable change across the 
metal-insulator transition [lfj. Bobroff et al. proposed 
that the insulating state is a result of successive SDW 
transitions due to the crossing of the Fermi surface (FS) 
with the orthorhombic zone boundary of \/3 x 2 Na or- 
der [1(3]. Recently, elastic neutron scattering discovered 
that AF order occurs at T m \ with a 2 x 2 hexagonal unit 
cell [lH . The ordering vector is clearly incompatible with 
and challenges the SDW scenario. 

In this paper, we study theoretically the electronic 
state at x = 0.5. The relevant low energy electronic 
structure involves three Co tig atomic orbitals forming 
one oi „ and two e' g bands in the solid. In a recent 
work [17j |. starting from the three-band Hubbard model 
of the tig complex with LDA band dispersions [l2j, it 
is shown that strong correlation renormalizes the crystal 
field splitting and the bandwidths and drives the e' g band 
below Ep, leaving a single band of mostly a\ g character 
near the Fermi level. The resulting quasiparticle disper- 
sion and FS topology are in agreement with ARPES over 



a wide range of Na doping pjj [3, [H| as well as in hy- 
drated samples [lj|. This justifies a single-band model 
for the basic low energy physics, provided that the strong 
Coulomb repulsion is included at the Co site. 

We consider here a single-band t-U-V model and study 
the interplay between the frustration of the kinetic energy 
and the AF spin correlations. Specifically, we extend 
the Gutzwiller approximation to the variational space 
spanned by spatially unrestricted and spin dependent 
densities. We find that the tendency towards inhomo- 
geneity due to strong correlation and magnetic frustra- 
tion work together to alleviate the AF frustration and 
produce a class of charge and spin ordered states. Here- 
after, we use the terms inhomogeneity, charge and spin 
order interchangeably to refer to a nonuniform electronic 
state where the densities of charge and spin are spatially 
and periodically modulated. At x = 1/3, the ground 
state has spontaneous y/3 x -\/3 charge and spin order 
even when V = 0. The frustration is avoided as the 
AF order develops on the honeycomb lattice and coexists 
with weak charge density modulations. At x = 0.5, we 
find that a large V is necessary to destabilize the uniform 
paramagnetic phase towards a state with V3 x 1 charge 
and AF spin order. This state is close to a Wigner crystal 
with a lar ge c harge disproportionation and a large insu- 
18 , 1|| , inconsistent with NMR [l(| , transport 



latin 



? a p 



, and ARPES experiments. We show that the 
V3 x 2 Na order at x = 0.5 induces a weak v3 x 1 charge 
order at high temperatures. The symmetry breaking al- 
lows -\/3x 1 AF order to develop at T m \. Remarkably, the 
FS at x = 0.5 coincides well with the 2x2 hexagonal zone 
boundary. This allows the 2x2 charge and spin order 
to develop by umklapp scattering at a lower temperature 
T m 2- The truncation of the FS into small electron and 
hole pockets marks the onset of the insulating behavior. 
We begin with the one-band t-U-V model 
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FIG. 1: (a)V3x\/3 charge and spin order at a; = 1/3 and 
V = 0. The charge and spin densities are a; = (0.32, 0.36, 0.32) 
and S z = (0.18,0.00, -0.18). (b) Nesting oi V3 x Vs zone 
boundary with the paramagnetic FS. (c) Intensity of the 
quasiparticle peaks at the Fermi level. 



where, c\ a creates an a\ g hole of spin a, n, is 
density operator, U and V are the on-site and long- 
range Coulomb repulsion. From the LDA a lg band dis- 
persion, the hopping parameters are chosen according to 
tij = (—202, 35, 29)meV for the first, second, and third 
nearest neighbors respectively. The local electron dop- 
ing density is given by Xi = 1 — 7ij. The large- U limit of 
Eq. ([I]) is usually treated in the Gutzwiller approximation 
(GA) 0, [5l| , which corresponds to the saddle point of 
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the slave-boson path integral formulation [22J . Since the 
superexchange interaction is very small in the cobaltates 
due to the small bandwidth and large-U, we neglect the 
AF Heisenberg interaction Q and consider magnetism of 
a kinetic origin. To encompass the Hilbert space with in- 
homogeneous charge/spin densities, we adopt a spatially 
unrestricted GA described by the renormalized mean- 
field Hamiltonian 
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where the Gutzwiller renormalization factor g^ - depends 
on the sites connected by the hopping integral , 
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The Ei a in Eq. ((2]) is a spin dependent local fugacity that 
maintains the equilibrium condition and local densities 
upon Gutzwiller projection [23|, 0|. It is determined by 
3{Hqa) jdn ia = 0. The spin density is S* — (n^ — 
riii)/2. If the charge density is forced to be uniform, the 
solution of Eq. ((2|) gives a stable paramagnetic phase up 
to xq ~ 0.67 where a ferromagnetic (FM) transition takes 
place. The AF order, t ypic al of large-U systems at small 
x on bipartite lattices [22|, is absent due to geometrical 
frustration. We show below that this frustration can be 
alleviated by forming inhomogcncous electronic states. 

To this end, we consider large triangular lattices of 
240 x 320 sites with 6x8 unit cells wherein Xi, n^, and 
Ei a are allowed to have spatial variations. They are de- 
termined self-consistently by standard iterations. First 
let's consider the case at x = 1/3. It is remarkable 



that even for V = the ground state has spontaneous 
•\/3x y/3 charge and spin order displayed in Fig. la. Frus- 
tration is alleviated as AF moments reside on the under- 
lying unfrustrated honeycomb lattice. The tendency to 
avoid AF frustration is materialized because the FS at 
x = 1/3 coincides with the V3 x v3 zone boundary, as 
shown in Fig. lb, such that weak charge order develops 
by the "umklapp" scattering and anisotropic gapping of 
the FS shown in Fig. lc. We find that charge and spin 
sectors are coupled in the sense that the removal of in- 
homogeneity in either will reinstate the uniform para- 
magnetic phase. This state is thus different from the 
\/3 x -s/3 charge ordered state proposed by Motrunich 
and Lee [HI, [26| near x = 1/3, which is a Wigner crys- 
tal due to Coulomb jamming under a large V, involving 
no spin ordering and a large insulating gap. In contrast, 
our charge and spin ordered state has a very small in- 
sulating gap at V — which increases gradually with 
increasing V. We point out that such a spin/charge or- 
dered state has not yet been observed at x = 1/3, most 
likely because of the Na dopant disorder [53]. Indeed, we 
find that a disordered Na potential of moderate strength 
destroys the long-range order. It will be interesting to 
examine whether enhanced AF fluctuations in proximity 
to the ordered state can lead to superconductivity. 

Next we turn to x = 0.5, which is not a natural com- 
mensurate filling on the triangular lattice. As a result, 
the uniform paramagnetic state is found to be stable 
for small V < V c , V c ~ 1.35eV. For V > V c , we find 
a first order transition to an inhomogeneous state with 
charge/spin order. Fig. 2 shows that, for V = 1.5eV, the 
moments are ordered into unfrustrated AF chains that 
are AF coupled and separated by nonmagnetic chains. 
This state is driven by strong long-range Coulomb V 
and stabilized by AF spin correlations. The charge den- 
sity has a y3 x 1 unit cell with strong disproportiona- 
tion close to the Co 3+ /Co 4+ configuration, resulting in 
a large charge gap. Indeed, similar "AF Wigner crys- 
tal" was recently proposed [l9( and independently inves- 
tigated by variational Monte Carlo on frustrated lattices 
[18j. It is important to note that while the -s/3 x 1 AF 
order can be described by a unit cell that is equivalent 
to the 2x2 hexagonal unit cell deduced from neutron 
scattering, the structure factor is different and the mag- 
netic Bragg peaks shown in Fig. 2 (green squares) only 
has two-fold symmetry. This differs from the hexago- 
nal Bragg peaks observed in neutron scattering, unless 
120 degree orientated domains of equal contribution are 
present llj. For this reason, we will continue to refer to 
this spin pattern as V3 x 1 AF order (see also Fig. 3b) 
and reserve the term 2x2 hexagonal unit cell for a state 
with hexagonal Bragg peaks (see Fig. 3c) . In view of the 
experimental findings of weak charge disproportionation 
by NMR [l(|, and small insulating gaps by transport, 
optics, and ARPES [HHEI, 

we conclude that this state, 
though indicative of the structure of the AF order by 
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FIG. 2: V3 x 1 charge and AF spin order at x = 0.5 and 
V — 1.5eV (lower right). The charge and spin densities: x = 
(0.05,0.95,0.05) and S z = (0.48,0.00,-0.48). Also shown 
are charge and magnetic zones and Bragg peak locations of 
different structures. Note the absence of Bragg spot at Mi 
for \/3 x 1 AF order. (2 x 2)h corresponds to the hexagonal 
magnetic zone and Bragg spots of the state shown in Fig. 3c. 

avoiding frustration via inhomogeneity, cannot describe 
the x = 0.5 phase of the cobaltates. 

It turns out that the Na dopant order plays an impor- 
tant but subtle role at x = 0.5. Below about 300K, Na 
orders into \/3 x 2 superlattice structures @, H| . This has 
led to the notion of an induced -s/3 x 2 electron charge 
order in the Co plane, which is ultimately responsible 
for the insulating state at x = 0.5. Three remarks are in 
order. First, the electrostatic potential from off-plane or- 
dered ionic dopants in transition metal oxides is usually 
not strong due to screening by phonons, interband transi- 
tions, and the mobile carriers. Thus, the induced charge 
order in the basal plane is at most moderate. Second, 
as the temperature is lowered, FS stability may occur 
depending on the charge ordering symmetry. The latter 
can be different from the symmetry of dopant order. Due 
to the fact that the zigzag chains of ordered Na dopants 
above and below a Co layer are staggered, the superlat- 
tice potential felt by the electrons has a higher symmetry 
and results in y/3 x 1 charge order with a much elongated 
orthorhombic zone than originally thought. Third, the 
breaking of the lattice symmetry makes it energetically 
favorable to develop AF order by alleviating frustration 
via weak charge inhomogeneity. 

The effect of the Na dopant potential is to add 
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to Eq. ([2]), where Vd is the potential strength and d z ~ a 
is the setback distance of Na to the Co plane. Includ- 
ing carrier screening of the dopant potential, we set 
V = 0.2eV and V d = 0.5eV in the calculation. The 
Gutzwiller renormalized mean-field theory in Eq. ^ en- 




FIG. 3: The self-consistent states at x = 0.5 for three differ- 
ent temperatures (a), (b), and (c). First column: charge/spin 
ordering patterns and the unit cells. Second column: FS with- 
out thermal broadening showing the anisotropic gapping of 
the FS. Third column: FS when intensity scale is reduced by 
four orders of magnitude showing the band folding along zone 
boundaries of corresponding charge/spin order. 



ables the calculation of the free-energy at finite temper- 
atures. We present the temperature evolution of the 
self-consistently determined states in Fig. 3, and that of 
the charge and spin density in Fig. 4. At a tempera- 
ture fcfiT = 20meV above T m ±, marked in Fig. 4, the 
electronic state shown in Fig. 3a has -\/3 x 1 charge or- 
der induced by the Na potential without magnetic order. 
Note that the charge modulation shown in Fig. 4 is weak 
(~ 2%) and the FS in Fig. 3a is not affected. Lowering 
the intensity scale by four orders of magnitude reveals 
the weak band folding patterns along the intersections of 
the FS with the y/3 x 1 zone boundary. As the tempera- 
ture is reduced, we find an AF transition at T m i marked 
in Fig. 4, below which vo x 1 AF order develops and co- 
exists with the -\/3 x 1 charge order. This state is shown 
in Fig. 3b at fc_eT = 14meV. The transition is primarily 
a spin ordering transition, involving small changes in the 
charge disproportionation (~ 3% from Fig. 4). This is 
consistent with NMR measurements 10]. Remarkably, 
Fig. 3b shows that the FS at x = 0.5 coincides well with 
the hexagonal magnetic zone boundary. However, since 
the structure factor of the V3 x 1 AF order breaks the 
hexagonal symmetry, the vertical sections of the FS re- 
main intact as the scattering between them is switched 
off by the absence of the magnetic Bragg peak at Mi in 
Fig. 2. Thermal broadening and the 120 degree domains 
may further weaken the features of T m \ in resistivity, op- 
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may be too small to have been detected in the neutron 
scattering experiments 
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FIG. 4: Temperature evolution of charge (electron dop- 
ing) and spin densities at three sites marked in Fig. 3. The 
spin/charge ordering transitions are marked by T m i and T m 2- 

tics, and ARPES measurements. Nevertheless, the FS 
topology change due to the emergence of electron-like 
FS pockets leads to the reduction and sign change in the 
Hall coefficient observed below T m \ [l|. 

Reducing the temperature further, we find a second 
transition marked as T m 2 in Fig. 4 associated with ad- 
ditional symmetry breaking. Below T m 2, small magnetic 
moments develop at the Co(2) sites. They are coupled 
ferromagnetically as shown in Fig. 3c at T = 0. Below 
T m 2 1 the charge and spin densities in Fig. 4 are all differ- 
ent on the three inequivalent Co sites. Hence the ground 
state has charge and spin order with identical 2x2 hexag- 
onal unit cell. Moreover, the Fourier transform of the 
spin density has now hexagonal Bragg peaks in a single 
domain (see Fig. 2) of similar weight at low tempera- 
tures. As a result of the combined 2x2 charge/spin 
order, the umklapp scattering destroys almost the entire 
FS as shown in Fig. 3c, leading to the onset of the metal- 
insulator transition below T m i- The residual electron 
and hole-like FS pockets have six-fold symmetry with a 
two-fold anisotropy and provide an explanation for the 
existence of small FS pockets observed by Shubnikov-de 
Haas oscillations [28[. The low temperature insulating 
behavior develops by the localization of the electronic 
states on the small FS pockets, such that the insulating 
state has a nonzero density of states, and in this sense, a 
pseudogap. We emphasize that the most important char- 
acter of the transition at T m 2 is the emergence of small 
FM moments at Co(2). Its ordering direction should not 
be taken literally since it is specific to the restriction 
to collinear spins in the Gutzwiller approach. The FM 
moment on Co (2), collinear with the AF moments on 
Co(l) and Co(3), causes magnetic frustration and leads 
to an imbalance of the AF moments shown in Fig. 3c. In 
fact, it is more energetically favorable for the small FM 
moment to point orthogonal to the AF moment so as to 
avoid frustration of the in-plane AF order. The physics of 
the second transition is, however, unchanged. The small 
FM moments have been observed by NMR experiments 
2^, 3(| as associated with the 53K transition, but they 



To summarize, we have shown that the unconventional 
insulating state at x = 0.5 is a result of the interplay 
among strong correlation, y3 x 1 weak charge order in- 
duced by Na dopant order, AF order by alleviated frus- 
tration, and the overlap of the FS with the 2x2 hexagonal 
magnetic zone boundary. A single band t-U-V model in- 
cluding the Na dopant potential for the electron doped, 
hole-like Co a\ g band on the triangular lattice captures 
the basic physics of the charge and spin order. The tran- 
sition temperatures T m \ and T m 2, the size of the mo- 
ments, and the insulating gap will depend on microscopic 
details and vary when Na is replaced by other isoelec- 
tronic atoms such as potassium in Kg.sCoCv However, 
the phase structure discussed here is expected to be uni- 
versal of the cobaltate family at x = 0.5. 
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